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Natural scenes, although complex in appearance, contain 
numerous statistical regularities. For instance, owing to 
surfaces and textures, neighboring pixels in natural 
images are strongly correlated in both space and time 
(Figure IB). These correlations create strong dependen- 
cies between neurons that may limit neural coding effi- 
ciency. Thus, to produce an efficient representation, it 
has been proposed that neural circuits in the early visual 
system function to remove extraneous stimulus correla- 
tions. Although extensively studied in the retina and 
LGN, the mechanisms of efficient coding in primary 
visual cortex (VI) remain elusive. The goal of this study 
is to establish a relationship between population coding 
in VI and spatial correlations in natural scenes. 

Mathematically, the Fourier amplitude spectrum 
describes second-order correlations between pixels. In 



contrast, the phase spectrum describes higher-order corre- 
lations, which arise due to edges and other salient features. 
To understand how stimulus correlations influence coding 
in VI, we developed a novel technique that allowed us to 
systematically perturb the Fourier amplitude spectrum of 
natural movies, while keeping the edge structure intact. 
Using this method, we generated movies with four differ- 
ent levels of spatial correlation (Figure lA). Visually, edges 
in the most decorrelated movies (KO spectrum) appear 
shaper, while edges in the most strongly correlated movies 
appear occluded (K2 spectrum). To assess how popula- 
tions of neurons respond to these movies, we performed 
high-speed 2-photon calcium imaging in layer 2/3 of 
mouse VI. This method permitted us to monitor the 
activity of close to 100 neurons with high spatial and tem- 
poral resolution. 
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Figure 1 Selectively perturbing spatial correlations alters the appearance of natural movies. (A) Example frames from a natural movie 
with 4 different levels of correlation. (B) Autocorrelation function quantifying the spatial correlations within the frames shown in (A). All colors 
are labeled in (A). 
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We hypothesized that neuronal networks in VI should 
decorrelate strongly correlated movies. Interestingly, we 
found that neurons responded to strongly correlated 
movies (K1.5, K2) with higher firing rates and with less 
variability than the decorrelated movies (KO, Kl). 
Response reliability was computed as the average over all 
pairwise correlations between all single trial responses to 
one given movie. This analysis revealed that response 
reliability decreased monotonically with increasing levels 
of spatial decorrelation in the movie (arrow in Figure 
lA). Because the edge structure of these movies was not 
altered, this result suggests that computations performed 
by VI neurons are modulated by spatial correlations. 
Next, we investigated how interactions between neural 
assemblies are altered by stimulus correlations. We 
found that signal correlation between neurons (SC) 
decreased monotonically with increasing level decorrela- 
tion. Noise correlation (NC), however, remained 
unchanged by the perturbation. By plotting SC as a func- 
tion of separation between neurons, we discovered that 
strongly correlated movies evoked long-range correla- 
tions between neurons. On the other hand, spatially dec- 
orrelated stimuli resulted in weak and separation- 
invariant correlations. In other words, the structure of SC 
between VI neurons is very closely matched to the struc- 
ture of spatial correlations in the stimulus. 

In summary, our work demonstrates that neurons in 
mouse VI adapt their coding strategy to match spatial 
correlations in the visual stimulus. Thus, unlike the retina 
where stimulus redundancy is removed via whitening, VI 
neurons preserve stimulus correlations. This strategy 
improves coding efficiency as it allows neurons to learn 
about the structure of the environment. 
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